Papers with objective quality
Backtranslation Feedback Improves User Confidence in MT, Not Quality (2021.naacl-main)
Copied to clipboard
Vilém Zouhar, Michal Novák, Matúš Žilinec, Ondřej Bojar, Mateo Obregón, Robin L. Hill, Frédéric Blain, Marina Fomicheva, Lucia Specia, Lisa Yankovskaya
| Challenge: | Inbound translation is a modern need for which the user experience has significant room for improvement, beyond the basic machine translation facility. |
| Approach: | They propose to provide cues that indicate the quality of MT output as well as suggest possible rephrasing of the source language. |
| Outcome: | The proposed feedback module increases user confidence in the produced translation, but not the objective quality. |
AgentDiagnose: An Open Toolkit for Diagnosing LLM Agent Trajectories (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Large Language Model (LLM) agents produce rich, multi-step trajectories that interleave observations, internal reasoning, and tool actions. |
| Approach: | They propose an open-source framework for diagnosing agent trajectories that quantifies five core agentic competencies and a visualization module that highlights trajectory semantics. |
| Outcome: | The proposed framework is extensible and compatible with most agent trajectories. |